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COPYRIGHT NOTICE 

A portion of the disclosure of this patent document contains material which is subject 
to copyright protection. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent document or the patent disclosure, as it appears in 
the Patent and Trademark Office patent file or records, but otherwise reserves all 
copyright rights whatsoever. 

Cross Reference To Related Applications and Claim of Priority 

This invention claims priority to the following co-pending U.S. provisional patent application, 
which is incorporated herein by reference, in its entirety: 

Paul J. Ausbeck, Jr., Provisional Application Serial No. [60/213,855], entitled 

"ISOMETRIC JOYSTICK USABILITY," attomey docket no. [20864.01000], filed, June 23, 
2000. 

Field of Invention 

The invention relates to using an isometric joystick to move the cursor on a computer screen 
and to produce button events for the computer's operating system. 

Background of the Invention 

One common feature of the modem computer interface is a mechanism for moving a cursor or 
pointer across the computer's display. For stationary computers the "mouse" is the most common 
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pointing mechanism. A related role for the mouse is to provide a method for attaching 
importance to certain pointer locations. Accordingly, mice universally provide at least one button 
to perform this task. 

Because of space and weight constraints, portable "laptop" or "notebook" computers often use 
a miniature isometric joystick in the role of a pointing device. Figure 1 shows an isometric 
joystick 100 manufactured by Synaptics, Inc. When installed in a computer, the lower portion 
110 of the joystick is hidden below the computer's keyboard with the nub 120 typically 
protruding between the "G" and "H" keys. 

The three dimensions in which the joystick conventionally measures input force are labeled on 
the axis 130 shown in Figure 1. Force in the xy plane parallel to the work surface is used to 
position the cursor. Force in the direction perpendicular to the work surface, z, is used to perform 
selection operations analogously to those performed by the primary mouse button. 

Prior Art 

The isometric joystick with the largest commercial success to date is the TrackPoint system 
from IBM Corporation. Currently, there are at least four patents that relate to improving the 
usability of the TrackPoint system. Two are related to optimizing pointer movement and two are 
associated with synthesizing selection operations. 

Parabolic-Sigmoid Transfer Function 

U.S. Patent No. 5,764,219 argues that the optimal transfer fimction to tie input force to cursor 
movement is parabolic-sigmoid or S shaped. The trace labeled "transfer function" in Figure 2 is 
an abstract S shaped transfer fimction. The key aspects of this shape are the two relatively flat 
regions sandwiched around a region of nonlinearly increasing response. 

At low input forces the output of the S transfer fimction is also low allowing precise pointer 
movement. For larger forces pointer movement speed is high and fairly constant over a wide 
range of inputs. Ostensibly, this allows the user to develop a more accurate estimate of pointer 
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speed during large movements. A more accurate speed estimate is postulated to help reduce 
target overshoot. 

One problem with the S transfer function is that its derivative is zero at minimum and 
maximum force values. The shape of the derivative of S is shown by the trace labeled 
"derivative" in Figure 2. The first zero in the derivative of S introduces a significant lag between 
initial application of small forces and perceptible pointer movement. At the other end, the 
possibility of target overshoot is increased due to the lag between decreased input force and 
decreased pointer velocity. 

Negative Inertia 

One attempt to compensate for pointer lag is the so-called "Negative Inertia" transfer function 
disclosed in U.S. Patent No. 5,570 J 11. The basic S shaped transfer function 

0„=S{F„) (1) 

of U.S. Patent No. 5,764,219 is augmented with a term that is proportional to the time deriva tive 
of inp ut force . If G is defined as the gain applied to the time derivative term, the difference 
equation formulation of the negative inertia transfer function is: 

The primary effect of negative inertia is to provide a response boost that makes the cursor speed 
up and slow down faster, thus compensating for the lag introduced by the 5 transfer function. The 
response boost is somewhat limited, however, since it is based upon ^he time derivat ive of the 
^input and only comes into play when input force js chan ging relatively rapidl y^ 

In the preferred negative inertia embodiment, G is actually larger than one. Since the output of 
the S transfer function is not defined for negative inputs, when a negative input occurs, S is 
applied to the magnitude of its argument and the sign of the output is reversed. This procedure 
allows for reverse motion or pointer "snap back" when input force rapidly decreases. 
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A significant problem with negative inertia is that the amount of reverse motion is very 
difficult for a human operator to control. Rather than accomplishing the intended task of 
immediately hitting small targets following large cursor movements, it may lead to undesired 
pointer motion just as the operator is fine-tuning the cursor's position. An additional 
complication of the large value of G is that input noise may be amplified enough to add 
noticeable jitter to a slowly moving cursor. The preferred negative inertia embodiment 
incorporates an additional input force deadband to avoid this problem. This extra deadband is 
quite ironic in that one of the primary objectives of negative inertia is to ameliorate sluggish 
cursor acceleration. 

Selection with Motion Correction 

The key problem that must be solved in order to perform selection with an isometric joystick 
is to separate selection information from the predominant movement information. Selection 
information is naturally associated with z axis and movement information with the xy plane. 
However, since jc and y forces are produced fiictionally some movement information leaks into 
the selection axis and vice versa. 

To overcome this inherent ambiguity, the particular force maneuvers that indicate selection 
must be carefully designed. The selection signature used in the IBM TrackPoint pointing system 
involves both the abs olute value of z and its rate of change. The details are disclosed in U.S. 
Patent No. 5,696,535 and the selection signature figxu*e from that patent is reproduced in Figure 
3. 

TrackPoint selection occurs when both z 300 and the first time derivative of z 310 
simultaneously exceed customizable thresholds. Deselection occurs when both z and 
dz/dt simultaneously drop below customizable thresholds. On Figure 3 the z selection threshold 
and the dz/dt selection threshold are labeled "2" and "1" respectively. The deselection 
thresholds are labeled "2" and "3". 
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The TrackPoint selection signature becomes increasingly immune against spxirious selection 
as 2 and dzfdt thresholds are increased. However, robust selection requires z and dzldt values 
that are large enough that the average user causes significant pointer motion during selection 
operations. For this reason the TrackPoint system also includes the ability to store and later 
unwind pointer motion that occurs during selection or deselection. 

This technique, called motion correction, is illustrated in block diagram form in Figure 4. The 
basic idea is to introduce a sufficient store of input samples to encompass the largest expected 
selection operation. When selection is detected, the input store is scanned backward to locate the 
start of the selection operation. Motion occurring between the start and end of the selection 
operation is reversed, the effect being that when selection occurs the pointer jumps back to the 
position it occupied just before initiation of selection. Correction is applied on deselection as 



One drawback of motion correction is that the process of moving the cursor and then 
unwinding the motion can be visually distracting or even annoying. A further complication is that 
storing and examining past force measurements can create implementation difficulties. This is 
especially an issue for portable devices where memory and computational resources may be at a 
premium. 

Multiple Selection with Motion Correction 

In U.S. Patent No. 5,912,659 selection with motion correction is extended to encompass 
multiple possible selection operations. The basic selection signature remains the same but when 
selection is detected, motion information in the correction buffer is used to disambiguate from 
among a number of possible selection operations. 

Figure 5 shows the top view of a sphere in the vector space defined by the x, and z forces 
accumulating during a selection operation. The polar cap, labeled z on the figure, represents the 
normal selection operation. In this region, the force vector that accumulates during selection lies 
very close to the z axis. 



well. 



12256578.1 



6 

The annulus surroxinding the polar cap represents the region where accumulated xy forces are 
significant but still substantially less than those in the z direction. The annulus can be split into 
one ore more angular regions to define multiple selection operations. For example, the region 
labeled z-y represents an accumulated force vector that lies mostly in the z direction but also 
contains a significant component in the negative y direction. 

The region labeled xy represents accumulated vectors that are more planar than vertical. Since 
these vectors are likely due to motion alone, selection operations that accumulate vectors in this 
region are quashed. 

While an interesting idea, multiple selection is difficult to master for a significant user 
population. The most important contribution of the patent is the idea of examining the correction 
buffer for additional clues to help discriminate selection fi-om intended motion. 

Motivation for the Present Invention 

The present inventor has realized that, taken as a whole, the IBM TrackPoint System is fairly 
complex and can be quite difficult for a novice user to master. The S transfer fimction allows for 
reasonable fine-grained and coarse pointer movement bu t acceleratio n and d ecele rationcan be 
perceiy ed as sl uggish. This is ameliorated somewhat by negative inertia but the i ncreas ed 
sensitivitjnm^es it difficult to per form selection operations without incurring significant pointer 
motion. Furthermore, unwinding motion that occurs during selection leads to xmpleasant 
extraneous pointer motion and can be relatively expensive to implement. 

Therefore, the present inventor has realized the need for a simpler system for optimizing 
pointer movement and selection o perations performed by^anj sometric joystick, hi addition to 
providing for efficient pointing and selection, the system should be easy for a computer operator 
to learn, avoid extraneous pointer motion, and allow for straightforward implementation. 
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Summary of the Invention 

The invention comprises an improvement in the usability of an isometric joystick when used 
as a pointing device controlling a computer display cursor. The invention improves pointing 
performance and selection. 

The present invention includes a device that uses at least one of a plurality of dual-gain 
transfer functions to provide improved pointing efficiency. These transfer functions have in 
common a jow gainjhat is applied to relatively _smaUJni)ut_Jorc^ a higher gain that is 
applied to relativelyja rger force s. The preferred function is continuous in the first derivative and 




provides for smoothly increasing pointing gain as input force increases. Pointing gain is 
relatively constant for both small and large input forces and adjusts between the two extremes in 
a manner that minimizes sluggish pointer feel. The preferred transfer function has two terms, a 



The invention includes a method for suppressing the high gain portion of a dual-gain transfer 
function. This method exploits the limited human ability to control the rate of decrease of applied 
joystick force. Except for relatively slow rates of decrease from relatively low applied force 
levels, motion accumulated from decreasing forces is almost never desired. The present invention 
minimizes this undesired motion by suppressing the high gain term of a dual-gain ballistics 
function during periods of decreasing pointing force. Unintended motion near the end of coarse 
movements is decreased while fine-grain motion is undisturbed. 

The invention includes methods for performing selection and deselection using an isometric 
joystick are provided. Novel selection and deselection signatures lead to selection discovery 
procedures that require only a single scalar register for holding state. Additionally, a customized 
combined selection/deselection signature is provided for separating intended pointer motion fi-om 
tapping operations. An adjunct mechanism allows for smoothly decreasing selection sensitivity 
as applied forces deviate from the purely vertical. 






increases using an S shaped blending function. 
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The invention also includes a final disclosure is a method for suppressing m otion that would 
otherwise occur during selection _a nd des election operation s. Since human operators almost never 
intend for motio n to occur v durin g periods of relatively rapidly decreasing z force^ as occurs 
during d eselectio n, motion occurring at such times is discarded. Further, ^only ^ motion produced^ 
by forces that ^relativel y close toJhe xv p lane/is allowed during the periods of relati v ely rapidly 
Li ncreasin g_z_force/ that are characteristic of^selection o perations; Discarded motion that is not 
associated with an actual selection or deselection operation remains unnoticeable. 

Brief Description of the Drawings 

Figure 1 shows an isometric joystick with the conventional labeling of input variables. 

Figure 2 shows the abstract form of a parabolic sigmoid transfer function used in the IBM 
Trackpoint isometric joystick system. 

Figxire 3 shows the selection signature used in the IBM Trackpoint isometric joystick system. 

Figure 4 is a block diagram of the cursor motion correction apparatus used in the IBM 
Trackpoint. 

Figure 5 shows the multiple selection criteria of U.S. Patent No. 5,912,659. 

Figure 6 is a block diagram of a closed cursor motion control loop of an isometric joystick. 

Figure 7 is a graph of several possible dual-gain transfer functions in accordance with the 
present invention. 

Figure 8 is a graph of derivatives of the transfer functions of Figure 7. 

Figure 9 is a graph of Normalized Input Force vs. Normalized Output Mickeys illustrating 
how gain is selected to take advantage of control asymmetry. 

Figure 10 is a diagrammatic illustration of a selection signature according to an embodiment 
of the present invention. 
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Figure 1 1 is a graph illustrating how selection is detuned as the direction of applied force 
moves away from the z axis. 

Figure 12 is a flow chart illustrating a deselection signature process according to an 
embodiment of the present invention. 

Figure 13 is a diagrammatic illustration of a tap signature process according to an embodiment 
of the present invention. 

Figure 14 is a flow chart illustrating how motion is suppressed in accordance with an 
embodiment of the present invention. 

Detailed Description of the Invention 

Pointer Motion Ballistics 

In classical ballistic motion, a projectile with an initially applied momentum moves under the 
influence of static extemal forces such as gravity or relatively static forces such as air resistance. 
The required initial velocity of a ballistic projectile is calculated by working back from the 
desired target and applying all the expected forces that occur along the path. In contrast, the 
trajectory of the pointer on a computer display is the result of both an initial velocity and 
continuous monitoring and adjustment by the human operator. Despite this nomenclature 
conflict, the algorithms that relate pointerjn ption to user i nput j re typically called ballistics 
algorithms. 

A block diagram of elements involved in moving a pointer on a computer display is shown in 
Figure 6. Pointer motion is accomplished via a classic closed loop feedback control system. The 
operator puts force on the joystick. This force is translated into motion reports to the computer by 
the ballistics subsystem. The computer operating system then moves the pointer on the monitor. 
The operator observes the trajectory of the pointer and modifies the input force to more optimally 
approach the target. 
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Because of this closed-loop aspect of the pointer system the chief requirement placed on the 
ballistics algorithms is that the transfer function must be easily leamable by the human operator. 
Subject to this constraint then, the ballistics transfer function must provide for both fine-grain 
and gross movements of the pointer as efficiently as possible. These two constraints lead to the 
following thesis to describe the ideal transfer function: 

The ballistics transfer function must be as smooth and simple as possible subject to the 
constraint that fine grain and gross movement must both be efficiently accommodated, 

Dual-Gain Transfer Function 

The force sensor in an isometric joystick is typically designed so that its output is linearly 
proportional to input force. While a linear output is ideal for mass-producing sensors with a 
standardized characteristic, it is inadequate to provide efficient pointing. The constant of 
proportionality chosen for relating input force and pointer motion leaves either fine-grained or 
gross motions inadequately served. For this reason, the present invention augments the output of 
the force sensor with a ballistics subsystem that alters the basic linear characteristic to one 
especially optimized for the pointing task. 

The ballistics subsystem operates in a sampled environment. The output of the force sensor is 
sa mpled periodically and the force sample^_£^s transform ed into Mn mickeys_ (a mickey is a unit 
that describes a minimum amount of pointer movement) of pointer motion using a ballistics 
function: 

J M„=B{F„), (3) 

While the ballistics function Js_not^linear, it is useful to define t he instantaneous_s lope or 
derivative of the ballistics function as its gain. To accommodate fme-grained motion, the 
ballisti cs gain is seU ow^High gain is used to accommodate coarse movements. T he simplest way 
to accommodate both tasks is with a tran s fer fi m ction w ith t wo gains: a low gmn^^^ applied 
when forces_aresm^ appUed t o larger forces. Several possible dual-gain 

transfer functions are shown in Figure 7. 
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Abrupt Gain Transition 

The simplest dual-gain transfer function is one with an abrupt transition between the low and 
high gain portions of its characteristic. In difference equation form this can be written as: 



where a is the input force aboye^hich high gain is applied and O is^an abstract step func tion 
which takes on a value of zero when Fn is less Aan q and one otherwise. Note that in this 
formulation low gain is also applied above the transition point. Since L is typically much smaller 
than H, this term does not contribute significantly to the high gain output. In any case, H can 
simply be defined as the difference between the required coarse movement gain and L. The trace 
labeled "Abrupt" on Figure 7 has a gain transition point at 30% of the maximum input force. 



While the abrupt dual-gain ballistic does provide for good fine-grain and coarse pointer 
motion it is not ideal for movements that lie between the two extremes. For medium-grain 
movements the kink in the gain characteristic may become noticeable and any noticeable artifact 
in the pointing apparatus tends to detract from efficient pointing. To eliminate noticeable 
artifacts, the transfer function must be "smooth". The smoothness of a mathematical function is 
related the number of its derivatives that are continuous. The first derivative of the abrupt dual- 
gain transfer function is plotted in Figure 8. As can be seen there is a large discontinuity in the 
derivative at a (Note "a" in Figs. 7 and 8). 

One way to create a transfer function with a^continuoi^^ in 
the higher gain as force increases: 



M„=LF„+H(^{F„-a){F„-a), 



(4) 



Blending 



M„=L-F„+H-B{F„).F„. 



(5) 



The simplest such function that is smooth is the linear blending function: 



B{F„) = BF„ 



(6) 



which when substituted into (5) results in: 
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„ =^LF„+HF„\ 

n n n 



(7) 



The curve labeled "linear blend" on Figure 7 is a plot of this transfer function. Its derivative, 
shown in Figure 8, is linear and therefore continuous as desired. However, the gain rises fairly 
quickly from L as force increases and this can slightly degrade fine-grained pointing. Further, the 
gain is not at all constant at larger forces. Therefore gross movements are slightly less efficient as 
the operator never gets a good estimate of the coarse-grained gain. 

A better gain characteristic should delay the onset of increasing gain and then more rapidly 
increase it to a more constant level. This is similar to the familiar S curve, not as the transfer 
function but as its derivative instead! The transfer function with initial gain, L, and having gain 
increase as 5 is 



This transfer function and its derivative are plotted on Figure 7 and Figure 8 as the traces labeled 
"5 Integral Blend". 

The S integral blend transfer function improves upon the linear blend but the gain does not 
become constant until very near the high end of the input force range. More importantly, the 
blending and input force components of the high order gain term are not separable. This can 
create problems when applying the function to signed values of input force and can cause 
anisotropic pointing behavior when the transfer function is independently applied to both the x 
and input forces. 

A nice way to solve both problems is to use the S function to blend multiplicatively: 



This transfer function and its derivative are plotted on Figure 7 and Figure 8 as the traces labeled 
"S Multiplicative Blend". 

The S multiplicative blend characteristic is a nice synthesis of all the required properties for 
good pointing efficiency. Its first derivative is continuous. Its gain does not increase too rapidly 




(8) 



M„:=L-F„+H-S{F„)-F„. 



(9) 
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in the low force regime. Its gain smoothly climbs_as_mputJo^^^ and is relatively 

consta nt in thej iigh force regime. This last property is particularly noticeable on Figure 7 smce 
for relatively large input forces it is somewhat difficult to distinguish the dual gain and abrupt 
characteristics. 

Isotropic Motion 

A significant problem with applying a non-linear gain to a vector in the xy plane is that if 
gains are independently applied to each vector component, the direction of the vector may be 
changed as well as the magnitude. One way to eliminate this problem is to use the magnitude of 
the raw input vector to select the gain. The magnitude of a two dimensional vector is the square 
root of the sum of the squares of each component, as shown in Equation 10, for example. 

K=4<^n- (10) 

An approximation of vector magnitude that allows for a basic implementation is: 

^„=kl + kl-^^ (11) 

^„=K| + k|-^ (12) 
Otherwise. 

If the gain and force terms in a dual-gain transfer function are separable, then the ballistics 
transformation can be made isotropic by using R in the blending term: 

M„={L^H^B{R„))^F„, (13) 

Of the previously described transfer functions, the abrupt, linear blend, and 5 multiplicative 
blend transfer functions are all separable. Their isotropic forms are: 

M„=(Z + //.<D(7?„-a)).F,, (14) 
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M„={L + H-R„)-F„, (15) 

and 

M„={L + H-S{R„))F„ (16) 
respectively. 
Control Asymmetry 

One fundamental aspect of using an isometric joystick to affect pointer movement is that the 
human operator can much more finely control an increase in the magnitude of the input force 
than a decrease. This difficulty in controlling decreasing force becomes more and more 
pronounced as the magnitude of the force increases. For instance, motion accumulated during 
decreasing force intervals may have some vague correlation to the operator's actual intent w^hen 
very fine movements are performed. However, motion accumulated during the rapid decrease in 
force that occxirs at the end of a gross movement is almost never desired. 

Because the dual-gain transfer function can be implemented with two distinct gains, the 
asynmietry in pointer control allows for a simple compensation mechanism for target overshoot 
after large movements. The mechanism is to\dro^Jiigh _gm motion / that [ accumulates durin g/ 
[decreases in i?/ For instance, the S multiplicative blend transfer function remains as before: 



M„=L>F„^H^S(R„)'F„ (17) 

dR 

if — >T, (T, zero or slightly negative) and simplifies to 
dt 

M„=L.F„ (18) 



otherwise. Use of this procedure with the S multiplicative blend transfer function is illustrated in 
Figure 9. 

Altering the value of the asymmetry constant, Tj, can vary the selectivity of the gain sv^tch. 
Note how this mechanism leaves fine-grain pointing completely undisturbed. 
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Fractional Mickey Accumulation 

If the smallest resolvable force is assigned a single mickey of pointer motion, the smallest 
non-zero pointer velocity available from an isometric joystick pointing system is simply the 
sample rate. For example, if T is the system sample rate, then T mickeys/s is the smallest non- 
zero pointer velocity. The typical sample period of 10 ms yields a smallest non-zero pointer 
velocity of 100 mickeys/s, far larger than that useful for fine grain movement. 

A related problem with joystick pointing systems is input noise. If the smallest resolvable 
force is set large enough so that a quiescent joystick never indicates motion, the resulting 
deadband around zero force results in perceptible pointer sluggishness. Both of these problems 
can be solved using the method of fractional mickey accumulation. 

With fractional mickey accumulation the smallest resolvable force is ^igned some fraction 
of a mickey that is less than one. Mickeys accumulate until such time as^least a single mickey is 
available. At that time the integral number of mickeys is reported to the operating system and the 
residual fraction is retained. Remarkably, this mechanism acts as a non-linear low pass filter 
whose passband is relatively small for small inputs and relatively large for large inputs. This is a 
very close to optimal solution for the input noise problem. 

Gain Adjustment 

The dual-gain transfer fiinction allows for jndgpendent adjustmentjof H and^. However, a 
single variable gain factor provides good pointer feel across a wide variety of motion 
sensitivities. Normalizing the fine-grain gain, to one, the S multiplicative blend transfer fiinction 
can be recast in adjustable form as: 

M„=Gr(F„+H-S{R„)-F„), (19) 

where G, is an adjustable gain factor and His a fixed factor larger than the normalized fine-grain 
gain. 
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Selection Operations 

Selection^s^mt dciam sm fo r using z fo r ce on an isometric joystick to s ynthesize presses and 
,releases^o£^what would otherwise be the computer's primary mouse button. The selection 
subsystem continually analyzes input force variables looking for particular patterns that emulate 
mouse button events. The pattern that indicates that a button dow n event should be synthesized is 
called the selection signatur e. The corresponding pattern that synthesizes a button release is 
called the deselection si gnature. 

Often a mouse button is pressed and released in rapid succession. The shorthand term for this 
is a mouse button click, A mouse button click can be naturally emulated via a tap on an isometric 
joystick. The input force pattern that emulates a mouse button click is called the Japjignature, 
Because a tap can be seen as selection followed rapidly by a deselection, a specialized tap 
signature is not a requirement for generating button click events. However, the additional 
temporal information inherent in a tap can be used to more robustly discriminate between motion 
and intended taps. 

Selection Signature 

A natural method for a human operator to j^ignal selection is to apply an increasing zjorce^, 
simult^ with the relative,_absgncg_of jy force. To detect this selection signature it is 
sufficient to examine the input force variables only when is increasing sufScier vtly rapij ly. 
/ouring these peri^ of increasing ^ two distinguishing criteria must be met. First the total 
^mount of z force applied mu^^ach a certainniii^^ the total amount of xy 

force applied must be substantially less jhan the z total) 

A simple mechanism for keeping track of the force appliedGuring perio ds of increas ing z^is to 
(accumulate a force vec tor, F, in the dimensions of z and 7?,^ here ^RJs Jhejpreviously described 
magm tude offlig jp^ input forc^ The difference between the z and R components of F is a good 
indication of the extent to which both a substantial z force and an insubstantial xy force has been 
appUed. An example selection signature is illustrated graphically in Figure 10. 
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If instead of separately accumulating both components of V the difference is accumulated, a 
single scalar parameter suffices to track the selection signature. Defining ^4 as the scalar selection 
parameter, its accumulation can be written in difference equation form as: 

A=A„_,+iz„-R„). (20) 
Selection occurs when A exceeds a configurable threshold, . By accumulating A only when 



dz 



dt 



dz 



dt 



meets or drops below r?, 



exceeds a configurable threshold, , and by zeroing A when 

A will always contain information from a single potential selection action. 
Selection signature discovery is summarized as follows: 
dz 

1 . If — > accumulate the scalar difference of the components of K in ^. 

2. If — <=7; resets. 

dt ' 

3. If A>=T^ indicate selection. 
Selection Detuning 

The just described selection signature discovery method has the property of being more 
sensitive to completely vertical presses and increasingly less sensitive to presses that deviate 
from vertical. This detuning property is completely smooth. Defining if as the angle that the 
accumulating force vector makes with the z axis, the relative immunity of the of the selection 
signature discovery process to forces applied at various angles is plotted in Figure 1 1 . When (j) is 
zero, as for a completely vertical press, the normalized force that must be applied is T-^ units. As (j) 
increases the force that must be applied to indicate selection increases more and more quickly. At 
^ of approximately 30° the sensitivity has been reduced by a factor of five. For ^ of 45° or 
greater, selection is impossible. 
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The preferred selectivity in discriminating between motion and selection varies from operator 
to operator. This need can be met by allowing customized adjustment of . As is increased 
not only is more z force required to indicate selection, but the direction of application must be 
increasingly aligned with the z axis. Therefore, users that require extreme immunity to spurious 
selection can be accommodated v^thout requiring an unduly large selection force. 

Deselection Signature 

Two factors make discrimination of deselection a streamlined operation. First, deselection can 
only occur fro m the selected state . Second, because of the stateflil nature of deselection , a rapid 
dz 

decrease in z, — <T., can be arbitrarily used as the deselection criterion. Computer operators 

~ dt 

can easily learn to avoid rapid decreases in z while the pointer is in the selected state. 



However,fusing rapidly decreasing ^as the only deselection criteria may allow for the slow 



desele ction is also triggered by removal of the finger from theJoysticjc. This is indicated by the 



magnitudes of x, y, and z simultaneously falling below a customizable threshold An example 



embodiment of the deselection signature discovery process is shown in Figure 12. 
Tap Signature 

A light tap on an isometric joystick is a natural way for a human operator to emulate a mouse 
button click. However, if a tap is light and quick enough, separate selection and deselection 
signatures can fail to detect it. The reason is that an accumulated z force threshold that is tuned 
for discriminating selection from motion is often not reached during the short period of 
increasing z that occurs during a tap. This problem can be solved by taking advantage of 
additional signature information peculiar to tapping actions. 

In a tap_gesture , a r^idjncrease^and j^^id^^ within a^certain^^ 

time window. Further, theamoun t of moti on occurring during a tap is conventionally quite small. 




removal of the finger from the joystick while retaining the selected state. To avoid this, 
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By adding these constraints to the tap signature the minimum z threshold that must be attained 
can be reduced to a value that is comfortably attained when tapping. 

An example tap signature discovery procedure that works well in practice is shown in Figure 

dz 

13. First a period of relatively ra pidly increasin g z, ~^^^e^ ^i^st be d etected . During this period 

of increasing z, a minimum z threshold, 2 > , must be attaine d. A relatively rapid de crease in z, 

dz I 

— < 7; , must then occur. The additional filter is that all three of these events must occur (svithin 

dt J " - 

^ time windo w^^Tg/and tha t motio n that accumulates between the detection of rapidly increasing 

and^ pidlv decreasin g z jmust beJless th an a thrgs holdyT'in . 
Motion Suppression 

Rather than unwinding it after the fact, the best way to avoid cursor motion during selection 
and deselection should be to suppress such motion as it occurs. Of course this can only be 
effective if it is possible to quash motion that is potentially associated wdth selection without 
interfering with pointer movement. Surprisingly, while transparently avoiding all selection 
motion is quite difficult, some uncomplicated techniques can avoid enough motion so that 
selection and deselection are reliably located. 

One advantage of the selection and deselection signatures described in the previous sections is 
that selection criteria are only developed during periods of relatively rapidly changing z. During 
selection, z increas es and during deselection z decreases. 

Suppression of unwanted deselection motion is quite straightforward. Relatively large 
decreases in z almost never occur in conjunction with legitimate pointer motion. Deselection 
motion can be largely eliminated simply by suppressing motion that occurs during periods of 
relatively rapidly decreasing z. 

During all periods of relatively rapidly increasing z, pointer motion can potentially occur. 
Ideally, this motion should be suppressed only if selection actually occurs, but allowed otherwise. 
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This is of course arguably impossible to do exactly as the motion must be suppressed before 
actual selection is indicated. 

Fortunately, force samples that represent desired motion are very likely to be largely near the 
pointing plane in the z-R coordinate space. Further, since z and R values are already available as 
part of selection signature discovery, it is a straightforv^ard matter to compare z with R during 
periods of relatively rapidly increasing z and suppress motion unless R exceeds z. 

The motion suppression procedure is illustrated in Figure 14. All force samples are examined 
for possible suppression before they are passed through the ballistics subsystem to form 
operating system motion reports. First, samples that occur during periods of relatively rapidly 

dz 

decreasing z, — < Tj,, are suppressed. Second, samples that occur during periods of relatively 
dt 

dz 

rapidly increasing z, — > T^^ ^ that are largely vertical, z„ > , are suppressed. All motion 
dt 

that is not suppressed is allowed. 

Preferred Embodiment 

A sample rate, force sensitivity, and maximum force applicable to using an isometric joystick 
for pointing on a laptop computer are shown in Table 21 . 



Parameter 


Preferred Value 


A 


80 samples/sec 


F 


0.8 grams/count 


Fmax 


±511 coimts (-400 grams) 



Table 1 



Given an input dynamic range of ±51 1 counts, a function for generating a normalized S curve is: 
1 - cos( ) 

5(x) = ^-512- . (21) 
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Overall, G, and high, H, gains appropriate for use in equation 19 are summarized in Table 2. An 
appropriate threshold (Ti) for applying asymmetric gain is also shown in the table. 



Parameter 


Preferred Value 


G 


1.5/256 


H 


16 


Ti 


0 



Table 2 



dz 

A method for approximating — is to maintain a slowly moving average {Za) of z: 

dt 



{k-l)'Za^_,^hz^ 



(22) 



dz 

and then obtain — as the difference between the current z value and the slowly moving average: 
dt 



dz ^ 

dt " 



(23) 



Values of k (number of samples in the moving average) and / (weight of a current z in the moving 

dz 

average) that are applicable to approximating — in selection, deselection and tap signatures are 

dt 

eight and one respectively. 

A useful maximum z force, Zmax, for performing selection is 400 grams. Typical threshold 
values for use with the selection, deselection and tap signatures of Figure 10, Figure 12, and 
Figure 13 are shown in Table 3. Threshold values for suppressing motion as described in Figure 
14 are also shown in the table. 



Threshold 


Preferred Value 


T2 


17 


T3 


z 


T4 


-.25z 



12256578,1 



22 



T5 




T6 


z + .052,3, 


T7 




Tg 


-.25z 


T9 


175ms 


T,o 


17 mickeys 


Tn 




T,2 


-l^n,ax 



Table 3 



The present invention may be conveniently implemented using a conventional general purpose 
or a specialized digital computer or microprocessor programmed according to the teachings of 
the present disclosure, as will be apparent to those skilled in the computer art. 

Appropriate software coding can readily be prepared by skilled programmers based on the 
teachings of the present disclosure, as will be apparent to those skilled in the software art. The 
invention may also be implemented by the preparation of application specific integrated circuits 
or by interconnecting an appropriate network of conventional component circuits, as will be 
readily apparent to those skilled in the art. 

The present invention includes a computer program product which is a storage medium 
(media) having instructions stored thereon/in which can be used to control, or cause, a computer 
to perform any of the processes of the present invention. The storage medium can include, but is 
not limited to, any type of disk including floppy disks, mini disks (MD*s), optical discs, DVD, 
CD-ROMS, micro-drive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, 
DRAMs, VRAMs, flash memory devices (including flash cards), magnetic or optical cards, 
nanosystems (including molecular memory ICs), RAID devices, remote data 
storage/archive/warehousing, or any type of media or device suitable for storing instructions 
and/or data. 
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Stored on any one of the computer readable medium (media), the present invention includes 
software for controlling both the hardware of the general purpose/specialized computer or 
microprocessor, and for enabling the computer or microprocessor to interact with a human user 
or other mechanism utilizing the results of the present invention. Such software may include, but 
is not limited to, device drivers, operating systems, and user applications. Ultimately, such 
computer readable media further includes software for performing the present invention, as 
described above. 

Included in the programming (software) of the general/specialized computer or 
microprocessor are software modules for implementing the teachings of the present invention, 
including, but not limited to, reading force values and identifying force components, calculating 
force accumulations, integrals, and derivatives, applying gains, recognizing thresholds, 
selections, and tap selections, and the display, storage, or communication of results according to 
the processes of the present invention. 

Obviously, numerous modifications and variations of the present invention are possible in 
light of the above teachings. It is therefore to be understood that within the scope of the 
appended claims, the invention may be practiced otherwise than as specifically described herein. 
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